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This  report  covers  the  period  of  February  1,  1962  to  February  1, 

1963 •  A  large  part  of  the  effort  during  this  year  was  devoted  to 
completing  the  research  of  L.  J.  Schrock  and  the  writer  on  ’'Quenching 
of  adaptive  control  system  response  to  test  signal"  and  preparing  the 
results  for  publication.  A  technical  report  with  the  above  title  was 
Issued  in  March,  1962  to  the  Distribution  List,  and  a  paper  with  the 
same  title  was  presented  to  the  American  Institute  of  Electrical  En¬ 
gineers  at  the  AIEE  Fall  General  Meeting,  Chicago,  Illinois,  October 
11,  1962.  This  paper  (AIEE  No.  62-1382)  will  be  published  in  the 
AIEE  Transactions.  The  problem  of  quenching  arose  in  a  study  of  adap^ 
tive  control.  The  theory  actually  applies  to  quenching  the  response 
of  a  system  to  a  known  signal  whether  or  not  adaptive  control  is  in¬ 
volved.  A  test  signal  may  be  employed  to  identify  the  parameters  of 
a  system  to  be  controlled.  In  adaptive  control  this  identification 
is  done  automatically. 

Unfort\inately,  the  teat  signal  disturbs  the  system,  resulting  in 
an  undesired  response.  This  response  may  be  of  appreciable  magnitude 
and  duration.  As  soon  as  the  system  is  known,  the  response  of  the 
system  to  an  arbitrary  input  can  be  computed.  The  problem  is  to  quench 
the  response  to  the  test  signal  by  the  introduction  of  an  appropriate 
signal.  The  systems  treated  are  assumed  to  be  described  by  linear  dif¬ 
ferential  equations  with  slowly  varying  coefficients  so  that  these  co¬ 
efficients  may  be  assumed  to  be  constant  during  a  given  identification, 
and  subsequent  quenching,  period.  Two  cases  are  treated.  One  occurs 
where  the  input  is  unbounded.  In  this  case  the  quenching  sigial  is  a 
linear  combination  of  a  properly  wei^ted  Impulse  and  weighted  deriv¬ 
atives  of  this  Impulse.  Such  combinations  may  be  approximated  in 
practice.  Quenching  is  assumed  to  be  optimum  if  the  Integral  squared 
error  is  a  minimum. 

In  the  second  case  the  absolute  value  of  the  input  is  bounded.  In 
this  case  quenching  that  is  optimum  in  every  reasonable  engineering  sense 
can  be  obtained.  The  boxinded  quenching  signal  is  obtained  by  scheduling 
the  lengths  of  time  that  its  v^ue  is  either  at  the  upper  or  lower  bound. 
As  soon  as  the  system  is  Identified,  quenching  can  be  accomplished  by 
scheduling  of  the  system  input,  regardless  of  the  other  disturbances  to 
which  the  system  is  subject  during  Identification  and  quenching.  If  the 
system  to  be  identified  is  simple  second  order,  that  is,  a  double  inte¬ 
grator  with  gain  as  a  parameter,  and  the  test  signal  is  a  step  input, 
the  quenching  signal  is  Indejpendent  of  the  system  and  depends  only  on 
the  test  signal  and  the  known  bound  on  the  input.  Thus  it  is  relatively 
easy  to  schedule  the  quenching  sl^al  in  this  case.  If  the  system  to  be 
identified  also  involves  a  first  order  lag,  the  quenching  signal,  up  to 
the  instant  it  is  removed,  is  indepiendent  of  the  system  parameters.  The 
instant  of  removal  depends  on  the  time  constant  of  the  system,  but  not 
the  system  gain.  Thus  it  is  again  relatively  easy  to  schedule  the  quench¬ 
ing  signal.  This  signal  is  computed  without  a  knowledge  of  system  char¬ 
acteristics  until  the  system  time  constant  is  determined.  When  this  time 
constant  is  known,  the  shut  off  time  is  computed.  Thus  in  the  basic  cases 
treated,  the  quenching  signal  is  independent  of  system  gain.  The  physical 
equipment  required  for  quenching  is  simplified  accordingly. 
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When  a  controlled  system  has  been  identified,  a  mathematical  model 
of  it  can  be  constructed.  In  automatically  adapting  the  controller  to 
the  system,  the  characteristics  of  the  controller  are  made  to  match  those 
of  the  system  model.  In  using  the  model  it  is  assumed  that  the  responses 
of  the  model  and  the  system  to  the  same  input  are  identical  for  practical 
purposes.  Actually  they  differ,  and  the  designer  should  know  by  how  much. 

The  delay  line  synthesizer  has  been  employed  successfully  for  identifica¬ 
tion.  The  synthesizer  is  based  on  the  principle  that  a  rational  transfer 
derivative  operator  may  be  represented  by  an  infinite  aeries,  where  this 
series  is  a  linear  combination  of  pure  delays,  all  of  these  delays  being 
positive  integral  multiples  of  a  given  delay.  In  physical  applications 
it  is  possible  to  work  only  vrlth  a  finite  number  of  terms.  The  closeness 
with  which  the  response  of  the  delay  line  model  agrees  with  that  of  the 
system  depends  on  the  number  of  terms  of  the  infinite  series  kept  for  the 
model,  and  on  the  nature  of  the  input.  Research  on  this  subject  began 
with  first  order  systems.  Substantial  mathematical  simplification  of  the 
problem  was  achieved  by  writing  the  transfer  operator  as  an  infinite  prod¬ 
uct  of  linear  operators.  The  principle  investigator  had  previously  used 
the  same  technique  to  simplify  the  mathematics  of  systems  with  distributed 
constants.  By  this  technique  it  is  possible  to  write  the  transfer  oper¬ 
ator  of  the  model  as  a  product  of  the  transfer  operator  of  the  given  sys¬ 
tem  by  an  operator  that  can  be  readily  approximated  to  any  desired  accuracy. 
The  effect  of  the  second  factor  on  performance  can  be  conveniently  deter¬ 
mined.  The  responses  of  the  model  and  system  to  commonly  occurring  inputs 
such  as  steps,  sinusoids,  pulses  and  rampe  were  correlated  with  the  num¬ 
ber  of  terms  used  in  the  model.  These  results  are  being  extended  to  other 
inputs  and  higher  order  systems.  Experience  shows  that  the  transfer  char¬ 
acteristics  of  physical  systems  to  be  controlled  generally  can  be  repre¬ 
sented  by  rational  operators  to  sufficient  accuracy  for  engineering  design 
purposes. 

In  practice,  the  inputs  or  rates  of  change  of  inputs  to  a  controlled 
system  are  physically  bounded  or  limited  by  the  designer  to  protect  the 
equipment.  The  problem  of  nonlinear  control  is  that  of  obtaining  the  best 
control  subject  to  the  bounds  involved.  Since  in  this  case  the  controller 
is  generally  nonlinear,  such  control  is  said  to  be  optimum  nonlinear.  The 
bounds  are  often  on  the  absolute  values  of  the  rates  of  change  of  the  in- 
pits.  The  principal  investigator  treated  linear  systems  with  one  controlled 
variable  and  one  controlling  variable  with  the  rate  of  change  of  the  con¬ 
trolling  variable  bounded.  He  proved  that  under  rather  general  conditions 
a  single  control  function  will  yield  optimvim  response  to  step  disturbances. 
This  function  will  not  give  optimum  or  near  optimum  response  to  arbitrary 
disturbances  since  staircase  approximations  to  commonly  occurring  random 
disturbances  Involve  intervals  between  steps  that  are  too  short.  The 
situation  is  different  if  pdecewise  linear  approximations  are  employed 
where  the  slopes  of  the  line  segments  are  arbitrary,  A  disturbance  is 
said  to  be  controllable  if  its  rate  of  change  is  such  that  a  perfect  con¬ 
troller  can  keep  up  with  the  disturbance  and  maintain  the  system  error  at 
or  very  near  zero.  If  the  rate  of  change  is  too  great  this  is  not  possible, 
a  system  error  will  arise,  and  the  disturbance  is  uncontrollable.  Success¬ 
ful  controllers  are  designed  so  that  the  disturbances  are  largely  controllable. 
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Otherwise  there  would  be  continually  objectionable  system  errors  and  the 
controller  would  be  relatively  ineffective.  In  eneineering  practice 
enough  power  usually  is  selected  for  the  controller  so  that  the  disturb¬ 
ances  are  controllable.  One  would  then  expect  disturbances  fluctuating 
violently  or  rapidly  from  one  direction  to  the  other  to  be  infrequent. 

This  is  actually  the  case  so  that  a  disturbance  may  be  approximated  by 
a  piecewise  linear  one  where  near  optimum  control  can  be  obtained  by 
using  a  control  function  chosen  to  give  optimum  response  to  a  ramp  dis¬ 
turbance.  N.  P.  Smith  and  the  principal  investigator  obtained  this 
function  for  commonly  occurring  linear  systems.  When  control  with  this 
function  was  tested  on  an  analog  computer  it  was  found  that  definitely 
better  response  was  obtained  for  arbitrary  as  well  as  ramp  disturbances 
than  can  be  secured  by  known  techniques,  such  as  with  a  control  functicnn 
optimum  for  step  disturbances.  This  discovery  led  to  an  analytical  study 
of  the  reasons  for  the  unexpected  Improvement  obtained  in  the  laboratory. 

The  principal  investigator  proved  that  if  an  uncontrollable  disturb¬ 
ance  is  followed  by  a  sufficiently  long  controllable  portion,  and  the 
disturbance  is  known  in  advance,  there  is  one  and  only  one  best  action 
of  the  controller  that  will  yield  a  response  optimum  in  every  reasonable 
engineering  sense,  such  as  minimum  time  to  equilibrium  where  the  system 
error  is  zero,  minimum  area  between  the  error  curve  and  the  time  axis, 
minimum  overawing,  minimum  underswing,  etc.  A  controller  is  said  to  be 
near  optimum  if  it  yields  approximately  the  same  system  response  as  if 
the  disturbance  were  known  in  advance.  It  was  proved  that  the  control 
function  optimum  for  ramps  normally  yields  nearly  optimum  response  to  an 
uncontrollable  disturbance  followed  by  a  one  or  two  segment  piecewise 
linear  controllable  section.  An  effort  is  being  made  to  extend  the  proof 
to  an  uncontrolled  disturbance  followed  by  a  piecewise  linear  controllable 
section  composed  of  an  arbitrary  number  of  straight  line  segments.  The 
controller  optimum  for  ramps  essentially  adapts  itself  to  the  rate  of 
change  of  the  disturbance,  hntil  now  optimum  control  studies  have  been 
limited  almost  entirely  to  bringing  a  system  from  one  state  to  another 
while  the  system  is  undisturbed  during  the  transition.  The  new  approach 
allows  the  system  to  be  subject  to  an  arbitrary  disturbance  while  the 
controller  brings  it  from  its  initial  to  its  final  state. 
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Attn  Dr.  Allen  Newell 

271 

1 

Department  of  Conoerce 

271 

2 

U.  S.  Patent  Office 

271 

3 

Washington  25,  D.  C. 

271 

4 

Attn  Mr.  Herbert  R.  Roller 
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275  1  Northwestern  University 

275  2  Computer  Sciences  Lab. 

275  3  The  Technological  Inst. 

275  4  Evanston,  Illinois 

275  5  Attn  Dr.  Julius  T.  Tou 

295  1  University  of  Pennsylvania 

295  2  Moore  School  of  Electrical  Engineering 

295  3  200  South  33rd  Street 

295  4  Philadelphia  4,  Pennsylvania 

295  5  Attn  Miss  Anna  Louise  Campion 

314  1  University  of  Pennsylvania 

314  2  Mechanical  Languages  Projects 

314  3  Moore  School  of  Electrical  Engineering 

314  4  Philadelphia  4,  Pennsylvania 

314  5  Attn  Dr.  Saul  Com,  Director 

331  1  Applied  Physics  Laboratory 

331  2  Johns  Hopkins  University 

331  3  8621  Georgia  Avenue 

331  4  Silver  Spring,  Maryland 

331  5  Attn  Document  Library 

333  1  Bureau  of  Supplies  and  Accounts,  Chief 

333  2  Navy  Department 

333  3  Washington,  D.  C. 

333  4  Attn  Code  W3 

339  1  U.  S.  Naval  Avionics  Facility 

339  2  Indianapolis  18,  Indiana 

339  3  Attn  Librarian,  Code  031*  2 

344  1  National  Aeronautics  &  Space  Administration 

344  2  Goddat*d  Space  Flight  Center 

344  3  Greenbelt,  Maryland 

344  4  Attn  Chief,  Data  Systems  Dlv.,  C.  V.  L.  Smith 

351  1  Federal  Aviation  Agency 

351  2  Bureau  of  Research  «td  Develoiment 

351  3  Washington  25»  D.  C. 

351  4  Attn/  RD-375  /Mr.  Harry  Hajman 

361  1  Cornell  Aeronautical  Laboratory,  Inc. 

361  2  PO  Box  235 

361  3  Buffalo  21,  New  York 

361  4  Attn/Systems  Requirements  Dept/AE  Murray/ 

363  1  Institute  for  Space  Studies 

363  2  475  Riverside  Drive 

363  3  New  York  27,  New  York 

363  4  Attn  Nr.  Albert  Arking 
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371  1  Stanford  University 

371  2  Electronics  Uiboratory 

371  3  Stanford,  California 

371  4  Attn  Prof.  N.  M.  Abramson 

373  1  Lincoln  Laboratory 

373  2  Massachusetts  Institute  of  Technology 

373  3  Lexington  73,  Massachusetts 

373  4  Attn  Library 

411  1  Commanding  Officer 

411  2  U.  S.  Naval  Postgraduate  School 

411  3  Monterey,  California 

411  4  Attn  Dr.  Richard  Dorf 

422  1  Waddell  Dynamics,  Incorporated 

422  2  5770  Soledad  Road 

422  3  La  Jolla,  California 

422  4  Attn  B.  L.  Waddell,  President 

430  1  Electronics  Research  Laboratory 

430  2  University  of  California 

430  3  Berkeley  4,  California 

430  4  Attn/  Director 

432  1  Mr,  Gordon  Stanley 

432  2  7685  South  Sheridan  Ct. 

432  3  Littleton,  Colorado 

432  4  /y<artin/Denver/ 

536  1  Institute  for  Defense  Analysis 

536  2  Communications  Research  Division 

536  3  Von  Neumann  Hall 

536  4  Princeton,  Nevr  Jersey 


